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Abstract. We examine the minimum amounts of useful memory for real-time, as opposed to 
one-way, computation using several different machine models. In most cases, we are able to show 
that the lower bounds established using arguments about one-way machines remain tight in the 
real-time case. It is shown that increasing the number of stacks of real-time pushdown automata 
can result in exponential improvement in the total amount of space usage for nonregular language 
recognition. 



1 Introduction 



The effects of restricting a Turing machine (TM) to a single left-to-right pass of its input 
string have been well studied since the early years of computational complexity theory. An 
important distinction in this regard is the one between real-time computation [Rab63b] . in 
which the machine is required to spend a single computational step on each input symbol, 
and one-way computation |SHI65j , where the input head is allowed to pause for some steps on 
the tape. These two modes are known to be equivalent in language recognition power in many 
setups. An important exception is quantum automata theory, where it has been shown that 
quantum versions of real-time finite automata |AI99|YSllj and pushdown automata |YFSAj 
are strictly less powerful than their more general one-way versions in some modes of language 
recognition. 

In this paper, we compare the real-time and one-way modes of computation from the point 
of view of the minimum amount of memory required by computers to recognize nonregular 
languages. Several variants of the TM model |Sip06| will be used in this study. All machines 
are equipped with a read-only input tape and a single worktape with a two-way read/write 
head. We will distinguish between the strong, middle, and weak modes of space complexity, 
whose definitions are reviewed below. We assume without loss of generality that none of the 
TMs we consider ever moves the work tape head to the left of its initial position. 
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— A TM is said to be strongly s{n) space-bounded if all reachable configurations on any 
input of length n have the work tape head at not more than s(n) cells away from its initial 
position^ 

— A TM is said to be middle s(n) space-bounded if all reachable configurations on any 
accepted input of length n have the work tape head at not more than s{n) cells away from 
its initial position. 

— A TM is said to be weakly s{n) space-bounded if there exists at least one accepting compu- 
tation tree containing no configurations that have the work tape head at more than s(n) 
cells away from its initial position, for any accepted input of length n. 

In the rest of the paper, Section [2] considers several specializations of the alternating 
TM model for both tally languages (i.e. those with unary input alphabets) and general ones, 
establishing that most minimum space bounds for nonregular language recognition dictated by 
previous work on one-way versions of these machines remain tight in the real-time case. Similar 
questions about some other computational models like pushdown and counter automata are 
examined in Section [3l Section [4] contains a list of open problems. 

2 Bounds for real-time alternating Turing machines 

Table [1] depicts the known tight bounds for the minimum space complexity of nonregular lan- 
guage recognition by various specializations of the alternating TM model for both the general 
and unary input alphabet cases in the one-way mode. (We refer the reader to |Sze94IMP95| 
for the proofs of the facts depicted in the table.) These clearly form lower bounds for the 
corresponding functions for real-time TMs. We will now proceed to prove that most of these 
bounds are tight, by demonstrating machines of the relevant types recognizing nonregular 
languages within the corresponding space bound. 



Table 1. Minimum space used by one-way TMs for recognizing nonregular languages. All 
bounds are tight. 





General input alphabet 


Unary input alphabet 




Strong 


Middle 


Weak 


Strong 


Middle 


Weak 


Deterministic TM 


logn 


logn 


log 71 


log n 


log 71 


log 71 


Nondeterministic TM 


logn 


log n 


log log 71 


log n 


log 71 


log log 71 


Alternating TM 


log n 


log log n 


log log n 


log n 


log 71 


log log 71 



Theorem 1. All the logarithmic bounds in Table{l\ remain tight for the real-time versions of 
the corresponding machines. 

^ We use the head position, rather than the number of nonblank cells, |Sze94| for measuring space usage, since 
real-time quantum TMs are known |YFSA] to be able to recognize nonregular languages by a technique that 
involves just moving the work head (0(n) steps) to the right, without writing any nonblank symbols. 



Proof. We present a real-time deterministic TM named P that recognizes a nonregular tally 
language using only logarithmic space. The single input symbol is a. The input string is 
assumed to be followed by the endmarker $ on the tape. The nonblank work tape symbols 
are (, ), 0, and 1. D will maintain a counter in reverse binary representation between the 
delimiters ( and ) on its work tape. At the beginning of the computation, T> expects to read 
four a's from the input, (rejecting otherwise,) and moves the work tape head right and then 
left during these four steps to write the string ( ) , and position the head on the symbol ( . 
Having initialized its counter, D enters the following loop: 

— the work tape head goes from symbol ( to symbol ) while incrementing the counter by 
one, and then, 

— the work tape head goes from symbol ) to symbol ( , while checking whether the counter 
value is a power of two or not. 

During the travel of the work tape head, we assume that it cannot be stationary on any 
symbol. Note that, if required, the place of symbol ) on the work tape is shifted one square 
to the right. If T> reads $ at any time when the work tape head is not placed on the symbol 
( , the input is rejected. When the work tape head is placed on symbol ( and the currently 
scanned symbol from the input tape is $, the input is accepted if the counter is a power of 
two, and rejected otherwise. 

Let Lj) be the language recognized by P. Let Oj be the i*'^ shortest element of Lx>, where 
i > 0. It is easy to see that the value of — |aj| increases as i increases. This leads to a 

trivial proof, using the pumping lemma for regular languages, of the nonregularity of Lx). 

Since P belongs to the most specialized machine class under consideration, and obviously 
uses O(logn) space to use a unary nonregular language, we conclude that all the logarithmic 
lower bounds in Table [J are tight for real-time machines as well. □ 

We note that Freivalds and Karpinski use a real-time logarithmic-size counter in order to 
demonstrate a lower time bound for probabilistic TMs in |FK95j . Such a counter could also 
be used to prove at least some of the bounds handled by Theorem [T] to be tight. To the best 
of our knowledge, the minimum space requirements for nonregular language recognition by 
these real-time machines have not been studied before. 

We will now turn our attention to the double logarithmic bounds for machines with general 
input alphabets in Table [H Our strategy is to modify the one-way machines which are used 
in demonstrating these results to obtain real-time machines with the same space complexity. 
The languages recognized by these new real-time machines will be "padded" versions of their 
counterparts in the one-way setup. Essentially, the real-time machine will consume a padding 
symbol (k) for each step of the one-way machine in which the input head pauses on the tape. 

Definition 1. Given a one-way deterministic, nondeterministic or alternating TM T>, the 
real-time TM T>^ of the same model variant is constructed as follows: 

— The input alphabet ofV^^ is Z'k = Z'uIk}, where E is the input alphabet ofT>, and k ^ U; 

— The work tape alphabets of the two machines are identical; 

— T>K skips over any prefix of k 's in its input until it sees the first non-n symbol, at which 
point it starts its emulation ofT> ; 

— On each input symbol other than k, emulates the state transition and work tape action 
of T> for that symbol; 



— After implementing a stationary transition (that is, one which does not move the input 
head,) ofT> in the manner described above, T)^ checks whether the next input symbol is n. 
If this is the case, T>i^ implements the transition that T> would be making while scanning 
the symbol that is the last non-n symbol scanned by D^, otherwise, rejects the input; 

— After implementing a transition of T> that moves T> 's input head to the right, skips over 
any k 's in the input without any state or work tape change, until it sees a non-n symbol. 

At the end, accepts or rejects as T) would, unless it has already rejected in the eventualities 
described above. 

Let h^ be a homomorphism such that 

— = X if X / K, and, 

— hi^in) = £. 

Definition 2. L-^ C i7* is the language recognized by D^, where T) is a one-way TM recog- 
nizing the language L C 17*. 

Lemma 1. h^^{L-i^) = L. 

Proof. It is obvious that h^[L-fi) C L. Assume that a string w & is recognized by the one- 
way alternating TM T). D may spend different amounts of time, pausing on different symbols, 
in different branches of its accepting computation tree. Let t be the maximum number of steps 
that P pauses for on any particular symbol in this tree. The string w' , obtained by inserting 
t k's after every symbol of w, is accepted by P^- D 

Remark 1. If L is not a member of class C that is closed under homomorphism, then L-^ is 
also not a member of C. In particular, if L is nonregular, then L-^ is also nonregular. 

Theorem 2. // L is recognized by a strongly space s{n)-bounded one-way TM D, then for 
any nondecreasing function t{n) such that s{n) £ 0{t{n)), the real-time TM D,.^ recognizing 
L-K is strongly 0{t{n))-space bounded. 

Proof. For any w £ U* , the space used by T)^ on any input which is a member of {w^^^ G 17* | 
hK^w^) = w} is at most equal to the space used by V on w. □ 

Theorem 3. If L is recognized by a middle space s{n)-bounded one-way TMT>, then for any 
nondecreasing function t{n) such that s{n) G 0{t{n)), the real-time TMD^ recognizing L.^ is 
middle 0{t{n))-space bounded. 

Proof. Similar to the proof of Theorem [2j □ 
Consider the nonregular language 

Lgcm = {a^b^ I M is a common multiple of all i < m}. 

Szepietowski [Sze88] showed that Lgcm is recognized by a middle space loglog(n)-bounded 
one-way alternating TM that we will call A. 

Corollary 1. The real-time alternating TM recognizing the nonregular language Lgcm-K 
is middle O (log log (n)) -space bounded. 



We are therefore able to state that the middle and weak space bounds for alternating 
TMs with general input alphabets in Table [1] are also tight for the real-time versions of these 
machines. 

Remark 2. There is no analogue of Theorems [2] and [3] for weak space, because some accepting 
path may use more space but use less time (i.e. perform fewer stationary moves) than the 
accepting path with the best space usage in the one-way machine, and the padding process 
described above may then yield some strings whose only accepting paths use unacceptably 
large amounts of space in the real-time machine. 

To examine the weak space bound case for nondeterministic machines with general input 
alphabets, we focus on the one-way machine M [Sze94] used to establish the corresponding 
lower bound in Table [1} The work tape of M is divided into three tracks. At the beginning 
of the computation, N nondeterministically selects a number ^ > 1, and writes it in binary 
on the top track. Any string containing an a after a 5 is rejected. For strings of the form 
aJ'h'^ ^ N calculates and stores the value of r mod (/) (resp., s mod (/)) on the middle track 
(resp., bottom track). When the end- marker is read, the numbers in the middle and bottom 
tracks are compared. If they are not equal, the input is accepted. The nondeterministic path 
corresponding to /, namely npath^, needs only 0(log(/)) space. 

If r = s, then r = s mod (/) for all / > 1, and the input would be rejected. Using a number- 
theoretical fact ( |Sze94j . page 22) which states that, whenever r 7^ s, there exists a number 
I G 0(log(r + s)) such that r ^ s mod (Z), one concludes that M is weakly loglog(n)-space 
bounded, and recognizes the nonregular language Lj^k = {a-'h^ \ j / k}. 

We will modify J\f to obtain a real-time TM recognizing a padded version of Lj^)., taking 
extra care to handle the additional complications of weak space bounds mentioned in the 
above remark. We do this by making sure that nondeterministic paths with larger values of I 
have greater runtimes than those with small values of I. 

We rewrite the program of M such that di, that is, the number of stationary steps per- 
formed during the processing of a single input symbol by the nondeterministic path containing 
I on the top track depends solely on I. For example, we can use the following strategy: 

— The work tape head is always placed on the leftmost nonblank symbol before reading the 
next input symbol, and, 

— The operations on the work tape are performed by shuttling the work tape head, which 
operates with the speed of one cell per step, between the leftmost and rightmost nonblank 
symbols c > times. 

By selecting a sufficiently large value for c, can be set to cflog/] + k for nondeterministic 
path npath;, where the exact value of /c G Z depends on the way the numbers are stored 
on the work tape. Thus, we can guarantee that for any /' > Z, the number of the stationary 
steps (on the input tape) of npath^/ cannot be less than that of npath;. Let M' be the one- 
way nondeterministic TM implementing this modified algorithm, and L-^^_^ be the language 
recognized by M'^. 

Lemma 2. The real-time nondeterministic TMMI^ recognizing the nonregular language L'j_^i^_^ 
is weakly O (log log (n)) -space bounded. 

Proof. Let w = a^'h^ be a member of Lj^k, and I be the smallest number satisfying r ^ s 
mod (/). Then, for all G -^j^fc-K satisfying hf^{wi^) = w, the nondeterministic path of A/"^ 
corresponding to / accepts the input. □ 



Table [2] summarizes the findings presented in this section. 



Table 2. Lower space bounds for nonregular language recognition by real-time TMs. The 
bounds we have shown to be tight are in boldface. 





General input alphabet 


Unary input alphabet 




Strong 


Middle 


Weak 


Strong 


Middle 


Weak 


Deterministic TM 


log?! 


logn 


logn 


logn 


logn 


logn 


Nondeterministic TM 


logn 


logn 


log logn 


logn 


logn 


log log n 


Alternating TM 


logji 


log logn 


log logn 


logn 


logn 


log log n 



3 Other real-time computational models 

The question of the minimum amount of useful space is also interesting for more restricted 
models, like pushdown or counter automata. The following facts are known about (one-way) 
pushdown automata (PDAs) with unrestricted pushdown alphabets: 

Fact 1. All deterministic PDAs which recognize nonregular languages are weakly 0{n)-space 
hounded \Gah84^ . 

Fact 2. Nondeterministic PDAs that use suhlogarithmic space recognize only finite languages 
IReiOTj . 

Fact 3. There exists a weakly logn-space bounded nondeterministic PDA that recognizes a 
nonregular language \Rei07^ . 

Counter automata |FMR67j (essentially, PDAs with a unary pushdown alphabet,) do not 
seem to have been investigated deeply in this regard. As an easy corollary of Fact [H we have 

Fact 4. o{n) -space bounded real-time deterministic counter automata cannot recognize non- 
regular languages. 

We now show that weakly logn-space bounded nondeterministic real-time counter au- 
tomata can recognize some nonregular languages. This bound is tight, due to Fact [2j 

Let {i)2 be the reverse of the binary representation of i G N. Consider the nonregular 
language 

Lrev-bins = {0(1)20(2)20 • • • 0(^)30 | k G Z+}. 

In the following, substrings of the form {0, 1}* delimited by a's will be called "blocks," and 
the term blocki will denote the z'th block to be encountered by the one-way input head. If 
blocki is nonempty, the number it represents in reverse binary will be denoted num{i). 

Theorem 4. The complement of Lrev-bins can be recognized by a weakly logn-space bounded 
real-time nondeterministic counter automaton. 



Proof. Along with its other tasks, the machine M_\f that we will build for recognizing this lan- 
guage will check whether the input string w is generated by the regular expression ((a{0, l}~^)'^a, 
and accept whenever it sees that w is not of this form. Ai_^f splits to two main nondetermin- 
istic paths at the beginning of the computation. One path will check whether num{l) fails to 
be 1, if not, it will try to find a pair of blocks which fail to represent consecutive numbers in 
the set {{blocki,block2), {blocks, blocks), {blocks, blocks), ...}. When such a failure is detected, 
the input will be accepted. The second main path performs the same check for pairs of blocks 
in the set {{block2, blocks), {blocks, blocks), (blocks, blocks), ...}. 

At the beginning of each such check for a pair [blocks, blocki^i), the counter value is zero. 
Upon scanning the fc'th bit of blocki, the counter is incremented to k, the value B that the 
fc'th bit of blocki^i at this position would have if num{i + 1) were indeed one greater than 
num{i) is computed, and a nondeterministic split is performed. One branch of this split, Pfirsti 
continues with the next bit of blocki, whereas the other branch, Psecondj skips over the rest of 
blocki, and uses the counter to find the /c'th corresponding bit of blocki^i, accepting if this 
bit is not B, or if the input ends prematurely, and rejecting otherwise. Upon reaching the a 
at the end of blocki, Pfirst increments the counter, computes the symbol that should not be in 
the corresponding position of the next block, and decrements the counter all the way through 
blocki+i, starting the scan of the pair {blocki+2, blocki^s) with an empty counter if it has not 
accepted earlier due to blocki-^-i being too short or too long for a proper successor of num{i). 

If the input string is not in Lrev-binst it should be accepted in at least one of the two main 
computational subtrees. Consider the earliest (i.e. shortest) accepting path, and say that it 
accepts when scanning blocki. The space used by the counter up to that point cannot exceed 
logi, and the length of the scanned input prefix is clearly more than i. We conclude that this 
path uses logn space in the counter. □ 

When alternating machines are considered, we can obtain a similar statement for middle 
space bounds: 

Theorem 5. Lrev-bins can be recognized by a middle logn-space bounded real-time alternating 
counter automaton. 

Proof. It is easy to see that this machine need perform only universal branchings, at precisely 
the points corresponding to the existential branchings of the machine Aij\f of the proof of 
Theorem m At the start, two main paths, corresponding to precisely the same sets of pairs of 
blocks as in M_\f, are created. We now insist that all bits of blocki-\-\ match the corresponding 
bits of the number that is one more than num{i), for all i. Since the counter space can never 
exceed logn for members of Lrev-bins, we have a middle space bound. □ 

We have considered only a single work tape in our real-time models until now. It is known 
|FMR67j that increasing the number of work tapes does increase the computational power 
of these machines. We show that deterministic PDAs and counter automata with two work 
tapes can recognize nonregular languages using sublinear space, doing better that the bound 
of Fact [1] for single-stack machines: 

Consider the language 

Leven-rev-bins = {0(0)20(1)20(2)20(3)20 • • • o(2A;)2o(2fc + 1)2 \ k > 0}. (1) 



Theorem 6. Leven-rev-bins can be recognized by a deterministic real-time PDA with two 
stacks, and the total amount of space used on the stacks for accepted strings is O(logn). 

Proof. Using the terminology of the previous proofs, one stack is used for checking that the 
pairs in {{blocki, block2), {blacky, blocks), ...} are related according to the language definition, 
whereas the other stack is used for the set {(block2,block3), {blocks, blacky), ...}. The space 
bound is calculated as in Theorem HI □ 

Theorem 7. For any j > 1, there exists a nonregular language that can be recognized by 

a deterministic real-time automaton with j (unary) counters, such that the total amount of 

1 

space used on the counters is 0{n^) for all input strings. 

Proof. We start by considering the language 

L2 = {aiaoaiOQaiaQai ■ ■ ■ oiUq \ k G N}, 

(inspired by |ABB80|Gab84j .) on the alphabet {ao,ai}. L2 is recognized by a deterministic 
real-time automaton with two counters. The algorithm, say, A2, is similar to, in fact simpler 
than, that of Theorem[6l As for the space usage, assume that the machine arrives at a decision 
to accept or reject after scanning the i'th block of oo's. Since the length of the scanned input 
prefix is more than X]/=i ^ + 1 = 0(^^)5 and the counters have used 0{i) space up to that point, 
the machine is strongly 0(\/n)-space bounded. Let Wj^k denote the /c'th shortest element of Lj. 
Note that A2 accepts W2,k with one counter containing zero, and the other counter containing 
k. 

We define 

L3 = {a2^«2,l«2t«2,2«2^i'2,3«2 " " " «2W^2,A: | G N} 

on the alphabet {00,01,02}- A deterministic real-time machine with three counters can rec- 
ognize -L3 as follows. The automaton processes each block delimited by 02 's by using two of 
the counters for implementing A2. If the input head arrives at the i'th 02 {i > 1), two of the 
counters contain zero, whereas the third counter contains i — 1. The two counters containing 
zero are now used to run A2 on the i'th block, while the remaining counter is used to check 
that the number of oi's in the i'th block is indeed i. Two counters have value zero, and the 
third one contains k when this machine accepts ws^k- By a reasoning similar to the one about 
L2 above, the space usage is 0(n3). The generalization to 

Lj^i = {ajW^^iajW^^20'jWj^^aj ■ ■ ■ CLjW^k | A; G N} 

is now simple. □ 

Even with one work tape, the probabilistic versions of these machines |HS10|Fre79j also 
require less space than the deterministic versions for recognizing some languages. The language 
Leven-rev-bins of Equation [T] can be recognized by a real-time probabilistic PDA with error 
bound I as follows: Reject the input at the start with probability |. With the remaining 
probability, toss a fair coin to split to two computational paths, each of which uses its single 
stack to mimic the corresponding stack of Theorem [6l If the input is in -^^even-re?;-bms i both 
paths accept, yielding an overall acceptance probability of |. Otherwise, at least one path 
rejects, resulting in an acceptance probability of at most ^. The space requirement for members 
of the language is O(logn), as in Theorem [6l 



With a similar approach, real-time probabilistic automata with one counter that can rec- 

1 

ognize any language of the Lj family from Theorem [7] using 0(nJ ) space for member strings, 
albeit with error bounds that increase with j, can be constructed. 

4 Open questions 

We conclude with a list of problems for future work. 

An obvious question left open in Section [2] is whether the double logarithmic lower bounds 
for the recognition of nonregular tally languages by real-time nondeterministic and alternating 
TMs are tight. 

How does alternation effect the amount of useful space for (both one-way and real-time) 
PDAs and counter automata? 

What are the lower total space bounds for nonregular language recognition for machines 
with multiple work tapes, as exemplified in Section [3p 

Real-time "nondeterministic" quantum Turing machines (i.e., those that accept with 
nonzero probability if and only if the input is a member of the language,) are known jYSlOj to 
be able to recognize nonregular languages even with constant space, whereas no such language 
can be recognized by small-space probabilistic Turing machines in this mode, since these are 
synonymous with nondeterministic TMs (Table [2]) . When two-sided unbounded error is al- 
lowed, probabilistic finite automata can recognize nonregular languages |Rab63a| . What are 
the minimum space requirements for real-time nonregular language recognition of probabilis- 
tic TMs in the bounded-error regime |Fre85] ? Can one improve on the space usage of the 
probabilistic machines mentioned at the end of Section [3]? 

Finally, what is the minimum amount of space required for a real-time quantum Turing 
machine to recognize a nonregular language with bounded error? 

Acknowledgement. We thank Stefan D. Bruda, Giovanni Pighizzini, Juraj Hromkovic, 
and Rnsins Freivalds for their helpful answers to our questions. 
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